Reception apparatus and transmission apparatus

ABSTRACT

Provided is a reception apparatus that includes an information processing section configured to generate an image at least either in a first mode for reading out a whole captured region or in a second mode for reading out a partial region in the captured region. At the time of readout in the second mode, the image processing section varies a readout rate depending on the region.

TECHNICAL FIELD

The present disclosure relates to a reception apparatus and atransmission apparatus.

BACKGROUND ART

One method of image exposure with an image sensor involves adjusting theexposure time of the image sensor in a manner acquiring images withappropriate brightness. The existing common method of compensating lackof sensitivity with an exposure time can lead to a motion blurcorresponding to the length of the exposure time in the case where amoving subject is captured. Methods have thus been proposed by which, atthe time of image signal acquisition from the image sensor, the exposuretime is shortened as much as possible to minimize the occurrence ofmotion blur. The methods involve using at least two frames overlaid oneach other for motion compensation to avoid the motion blur, therebysolving the problem of lack of sensitivity or a reduced S/N ratio withregard to appropriate exposure.

Recent years have seen more image sensors being developed for higherresolution. Given the proposed techniques above, a high-resolution imagesensor needs an internal buffer memory if the time required to transfermultiple acquired images exceeds a transferrable time under hardwareconstraints. Solutions to such a problem have been proposed with suchtechniques as those of PTL 1 to PTL 4 cited below.

CITATION LIST Patent Literature [PTL 1]

Japanese Patent Laid-open No. 2008-160881

[PTL 2]

Japanese Patent Laid-open No. Hei 11-331643

[PTL 3]

Japanese Patent Laid-open No. 2001-250119

[PTL 4]

Japanese Patent Laid-open No. 2002-230544

SUMMARY Technical Problem

Still, the technique disclosed in PTL 1 is subject to constraints on thegeneration of images in the high dynamic range. The techniques disclosedin PTL 2 to PTL 4 involve estimating and removing the motion blur fromcaptured images, requiring complex algorithms and circuitconfigurations.

Thus, the present disclosure proposes a novel and improved receptionapparatus and transmission apparatus capable of suppressing thegeneration of motion blur, generation of saturated regions, andgeneration of reduced S/N ratio at the same time.

Solution to Problem

According to the present disclosure, there is provided a receptionapparatus including a reception section configured to receive image dataat least either in a first mode for receiving the image data of a wholecaptured region or in a second mode for receiving the image data of onlya partial region in the captured region, and an information processingsection configured to generate an image based on the image data receivedby the reception section. At the time of image data receipt in thesecond mode, the information processing section receives the image datato which a parameter different from that in the first mode is added.

Also according to the present disclosure, there is provided atransmission apparatus including an image processing section configuredto read out image data at least either in a first mode for reading out awhole captured region or in a second mode for reading out a partialregion in the captured region, and a transmission section configured tostore the image data read out by the image processing section into atransmitting signal complying with a predetermined format beforetransmitting the image data. The image processing section varies a rateat which the image is to be read out in the second mode.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is an explanatory diagram depicting a configuration example of acommunication system 1000 embodying the present disclosure.

FIG. 2 is an explanatory diagram depicting a packet format according tothe MIPI CSI-2 standard.

FIG. 3 is an explanatory diagram depicting another packet formataccording to the MIPI CSI-2 standard.

FIG. 4 depicts explanatory diagrams illustrating signal waveformexamples related to the transmission of packets according to the MIPICSI-2 standard.

FIG. 5 is an explanatory diagram outlining the operations of an imagesensor 100.

FIG. 6 is another explanatory diagram outlining the operations of theimage sensor 100.

FIG. 7 is a hardware block diagram depicting a configuration example ofthe image sensor 100 of the present embodiment.

FIG. 8 is an explanatory diagram depicting a specific example of datatransmitted by the image sensor 100 of the present embodiment.

FIG. 9 is an explanatory diagram depicting another specific example ofdata transmitted by the image sensor 100 of the present embodiment.

FIG. 10 is a view depicting a configuration example of a processor 200of the present embodiment.

FIG. 11 is another explanatory diagram outlining the operations of theimage sensor 100.

FIG. 12 is another explanatory diagram outlining the operations of theimage sensor 100.

FIG. 13 is an explanatory diagram depicting another specific example ofdata transmitted by the image sensor 100 of the present embodiment.

FIG. 14 is another explanatory diagram outlining the operations of theimage sensor 100.

FIG. 15 is another explanatory diagram outlining the operations of theimage sensor 100.

FIG. 16 is another explanatory diagram outlining the operations of theimage sensor 100.

FIG. 17 is another explanatory diagram outlining the operations of theimage sensor 100.

FIG. 18 is an explanatory diagram depicting an example of ROI regions.

FIG. 19 is an explanatory diagram depicting an example of the dataformat for ROI regions.

FIG. 20 is an explanatory diagram depicting a structural example ofpackets for use in the transmission of image data by the communicationsystem of the present embodiment.

FIG. 21 is an explanatory diagram explaining an extension provided in apacket header.

FIG. 22 is another explanatory diagram explaining the extension providedin the packet header.

FIG. 23 is an explanatory diagram explaining the format of data fortransmission.

FIG. 24 is an explanatory diagram explaining a structural example of thepacket header.

DESCRIPTION OF EMBODIMENT

A preferred embodiment of the present disclosure is described below withreference to the accompanying drawings. Note that, throughout theensuing description and the drawings, the constituent elements havingsubstantially identical functions and configurations are represented bythe same reference signs, and redundant explanation is not repeated.

The description is made in the following order:

1. Embodiment of the present disclosure

-   -   1.1. Background    -   1.2. Configuration examples    -   1.3. Operation examples

2. Conclusion

1. Embodiment of the Present Disclosure 1.1. Background

Prior to a detailed explanation of the embodiment of the presentdisclosure, the background of how the present disclosure came about isexplained first.

One existing common method of image acquisition and exposure with animage sensor involves adjusting the exposure time of the image sensor ina manner acquiring images with appropriate brightness. For example, inthe case where a moving image of 30 fps is acquired and where thesubject is so bright as to cause overexposure, attempts are made tomaintain appropriate brightness with an exposure time shorter than 1/30seconds (≈33.3 milliseconds). On the other hand, in the case where thesubject is so dark as to cause underexposure, attempts are made toacquire the image by using a maximum exposure time of 1/30 seconds thatcan be allocated to one frame at 30 fps.

However, the existing common method of compensating the lack ofsensitivity with exposure time has the problem of incurring a motionblur corresponding to the length of exposure time when a moving subjectis captured. One solution to this problem is the known method ofshortening the exposure time as much as possible to minimize theoccurrence of motion blur at the time of image acquisition from theimage sensor, with at least two acquired frames of the image signalbeing used for motion compensation. The images are thus overlaid on oneanother in a manner averting the motion blur, which makes it possible toprevent lack of sensitivity or a reduced S/N ratio with regard toappropriate exposure.

In recent years, more image sensors for higher resolution have beendeveloped for the purpose of surveying extensive areas with enhancedresolution, for example. Given the above-cited existing techniques, thehigh-resolution image sensor needs an internal buffer memory if the timerequired to transfer multiple acquired images from the image sensorexceeds a transferrable time subject to hardware constraints.

On the other hand, even with appropriate exposure at 1/30 seconds for awhole image, a partial bright portion in the image may be saturated whenacquired. PTL 1 proposes the technique for dealing with such a case. Theproposed technique involves acquiring as many as n images separately atn times upon acquiring a single-frame image, the n images beingsubjected to signal processing such as to obtain an image in the highdynamic range. However, the technique disclosed in PTL 1 is capable ofgenerating high-dynamic range images only at a maximum frame rate of 1/nwith regard to a moving image of the maximum frame rate calculated fromthe hardware constraints on the transfer rate.

The solutions to the phenomenon of motion blur occurring in proportionto the length of exposure time have been proposed in PTL 2 to PTL 4, forexample, including a method of removing the motion blur from capturedimages (motionless and moving images) and an image processing apparatusdesigned for motion blur removal. PTL 2 describes an image processingmethod for removing motion blur from captured images, the method beingapplied to an apparatus that enables images captured at 900 fps orhigher to be displayed on a display apparatus of 30 fps. Further, PTL 3and PTL 4 describe real-time image processing methods for removingmotion blur from a captured image before outputting the image. However,the techniques described in the pieces of cited literature all involveestimating and removing the motion blur from captured images. In thisrespect, it is difficult for these techniques to completely remove themotion blur besides requiring complex algorithms and circuitconfigurations.

In view of the above circumstances, the discloser of the presentdisclosure carefully studied techniques of reducing the generation ofmotion blur, generation of saturated regions, and generation of reducedS/N ratio simultaneously. As a result, as will be explained below, thediscloser of the present disclosure conceived of the technique ofreading regions set in the image, thereby simultaneously reducing thegeneration of motion blur, generation of saturated regions, andgeneration of reduced S/N ratio.

The preceding paragraphs have discussed the background of how thepresent disclosure came about. What follows is a detailed explanation ofhow the present disclosure may be implemented.

1.2. Configuration Examples

(1) Configuration of the Communication System to which a TransmissionMethod of the Present Embodiment May be Applied

Explained first is a configuration example of the communication systemto which a transmission method of the present embodiment may be applied.

Explained below is an example in which the apparatuses constituting thecommunication system of the present embodiment communicate with eachother by a method complying with the MIPI (Mobile Industry ProcessorInterface) CSI-2 (Camera Serial Interface 2) standard. It is to be notedthat the MIPI CSI-2 standard is not limitative of the methods ofcommunication between the apparatuses constituting the communicationsystem of the present embodiment. Alternatively, a communication methodcomplying with another standard worked out by the MIPI alliance, such asthe MIPI CSI-3 standard or the MIPI DSI (Display Serial Interface)standard may be adopted for communication between the apparatusesconstituting the communication system of the present embodiment, forexample. In addition, obviously, the standards worked out by the MIPIalliance are not limitative of the methods of communication between theapparatuses constituting the communication system of the presentembodiment.

FIG. 1 is an explanatory diagram depicting a configuration example of acommunication system 1000 embodying the present disclosure. Examples ofthe communication system 1000 include a communication apparatus such asa smartphone, a drone (a device that can be operated remotely or can actautonomously), and a mobile object such as a car. Note that theseexamples are not limitative of the examples of the communication system1000 to which the present disclosure may be applied. Other examples ofthe communication system 1000 will be discussed later.

The communication system 1000 has an image sensor 100, a processor 200,a memory 300, and a display device 400, for example.

The image sensor 100 has an imaging function and a transmission functionand thereby transmits data indicative of an image generated by imaging.The processor 200 receives the data transmitted from the image sensor100 and processes the received data. That is, in the communicationsystem 1000, the image sensor 100 acts as a transmission apparatus andthe processor 200 as a reception apparatus.

Note that, although FIG. 1 depicts the communication system 1000 havinga single image sensor 100, this is not limitative of the number of imagesensors 100 possessed by the communication system of the presentembodiment. Alternatively, the communication system embodying thepresent disclosure may have two or more image sensors 100, for example.

Further, although FIG. 1 depicts the communication system 1000 having asingle processor 200, this is not limitative of the number of processors200 possessed by the communication system of the present embodiment.Alternatively, the communication system embodying the present disclosuremay have two or more processors 200, for example.

In a communication system that has multiple image sensors 100 andmultiple processors 200, there may be a one-to-one correspondencetherebetween. Alternatively, one processor 200 may correspond tomultiple image sensors 100. Also in the communication system that hasmultiple image sensors 100 and multiple processors 200, one image sensor100 may correspond to multiple processors 200.

Also in the communication system that has multiple image sensors 100 andmultiple processors 200, communication takes place between the imagesensors 100 and the processors 200 in a manner similar to that of thecommunication system 1000 depicted in FIG. 1.

The image sensor 100 and the processor 200 are electrically connectedwith each other by a data bus B1. The data bus B1 is a signaltransmission path that connects the image sensor 100 with the processor200. For example, the data indicative of an image sent from the imagesensor 100 (the data may be referred to as “image data” hereunder) istransmitted from the image sensor 100 to the processor 200 over the databus B1.

In the communication system 1000, signals are transmitted over the databus B1 by a communication method complying with a predetermined standardsuch as the MIPI CSI-2 standard, for example.

FIGS. 2 and 3 are explanatory diagrams depicting packet formatsaccording to the MIPI CSI-2 standard. FIG. 2 depicts a short packetformat prescribed by the MIPI CSI-2 standard, and FIG. 3 depicts a longpacket format prescribed by the MIPI CSI-2 standard.

The long packet constitutes data including a packet header (“PH”depicted in FIG. 3), a payload (“Payload Data” depicted in FIG. 3), anda packet footer (“PF” depicted in FIG. 3). The short packet, as depictedin FIG. 2, constitutes data that has a structure similar to that of thepacket header (“PH” depicted in FIG. 3).

The short packet and the long packet each record a VC (Virtual Channel)number (“VC” depicted in FIGS. 2 and 3; VC value) in the header part.Each packet may be assigned an appropriate VC number. The packets thatare assigned the same VC number are handled as the packets belonging tothe same image data.

Also, the short packet and the long packet each record a DT (Data Type)value (“Data Type” depicted in FIGS. 2 and 3) in the header part. Thus,as with the VC number, the packets that are assigned the same DT valuemay be handled as the packets belonging to the same image data.

“Word Count” in the header part of the long packet records the end ofthe packet by using a word count. “ECC” in the header part of the shortpacket and of the long packet records an Error Correcting Code.

According to the MIPI CSI-2 standard, a high-speed differential signalis used in a data signal transmission period, and a low-power signal isused in a data signal blanking period. Further, the period in which thehigh-speed differential signal is used is referred to as the HPS (HighSpeed State) period, and the period in which the low-power signal isused is referred to as the LPS (Low Power State) Period.

FIG. 4 depicts explanatory diagrams depicting signal waveform examplesrelated to the transmission of packets according to the MIPI CSI-2standard. In FIG. 4, subfigure A depicts an example of packettransmission, and subfigure B depicts another example of packettransmission. The acronyms “ST,” “ET,” “PH,” “PF,” “SP,” and “PS” inFIG. 4 stand for the following:

-   -   ST: Start of Transmission    -   ET: End of Transmission    -   PH: Packet Header    -   PF: Packet Footer    -   SP: Short Packet    -   PS: Packet Spacing

As depicted in FIG. 4, the differential signal in the LPS period (“LPS”depicted in FIG. 4) and the differential signal in the HPS period (otherthan “LPS depicted in FIG. 4) are recognized to be different inamplitude. Thus, from the point of view of improving transmissionefficiency, it is preferred that the LPS periods be excluded as much aspossible.

The image sensor 100 and the processor 200 are electrically connectedwith each other by a control bus B2, for example, which is differentfrom the data bus B1. The control bus B2 is another signal transmissionpath that connects the image sensor 100 with the processor 200. Forexample, control information output from the processor 200 istransmitted from the processor 200 to the image sensor 100 over thecontrol bus B2.

The control information includes, for example, information for controlpurposes and processing instructions. Examples of the information forcontrol purposes include the data for controlling the function of theimage sensor 100, such as at least data indicative of an image size,data indicative of a frame rate, or data indicative of an output delayamount ranging from the receipt of an image output instruction to theoutput of an image. Further, the control information may also includeidentification information identifying the image sensor 100. Theidentification information may, for example, be any appropriate datathat can identify the image sensor 100, such as ID set to the imagesensor 100.

Note that the information to be transmitted from the processor 200 tothe image sensor 100 over the control bus B2 is not limited to theabove-mentioned examples. Alternatively, the processor 200 may transmitregion designation information designating regions in the image over thecontrol bus B2, for example. The region designation information mayinclude data of an appropriate format for identifying regions, such asdata indicative of the positions of the pixels included in the region(e.g., coordinate data representing the coordinates indicative of thepositions of the pixels in the region).

Although FIG. 1 depicts an example in which the image sensor 100 and theprocessor 200 are electrically connected with each other by the controlbus B2, the image sensor 100 and the processor 200 need not be connectedvia the control bus B2. Alternatively, the image sensor 100 and theprocessor 200 may exchange the control information therebetween bywireless communication based on an appropriate communication method, forexample.

Explained below are the components constituting the communication system1000 depicted in FIG. 1.

(1-1) Memory 300

The memory 300 is a recording medium possessed by the communicationsystem 1000. Examples of the memory 300 include a volatile memory suchas a RAM (Random Access Memory) and a nonvolatile memory such as a flashmemory. The memory 300 operates on the power supplied from an internalpower supply such as a battery (not depicted) constituting part of thecommunication system 1000, or on the power supplied from a power sourceexternal to the communication system 1000.

The memory 300 stores, for example, images output from the image sensor100. The recording of images to the memory 300 is controlled by theprocessor 200, for example.

(1-2) Display Device 400

The display device 400 is a display device possessed by thecommunication system 1000. Examples of the display device 400 include aliquid crystal display and an organic EL display (OrganicElectro-Luminescence Display; also referred to as an OLED display(Organic Light Emitting Diode Display). The display device 400 operateson the power supplied from an internal power supply such as a battery(not depicted) constituting part of the communication system 1000, or onthe power supplied from a power source external to the communicationsystem 1000.

The display screen of the display device 400 displays diverse images andscreens, such as images output from the image sensor 100, screensrelated to applications executed by the processor 200, and screensrelated to UI (User Interface), for example. The display of images andothers on the display screen of the display device 400 is controlled bythe processor 200, for example.

(1-3) Processor 200 (Reception Apparatus)

The processor 200 receives data transmitted from the image sensor 100and processes the received data. As discussed above, the processor 200acts as a reception apparatus in the communication system 1000. Atypical configuration related to the processing of the data transmittedfrom the image sensor 100 (i.e., a configuration for playing the role ofa reception apparatus) will be discussed later.

The processor 200 includes at least one processor including anarithmetic circuit, such as an MPU (Micro Processing Unit), and variousprocessing circuits, for example. The processor 200 operates on thepower supplied from an internal power supply such as a battery (notdepicted) constituting part of the communication system 1000, or on thepower supplied from a power source external to the communication system1000.

The processor 200 performs various processes including the process ofcontrolling the recording of image data to a recording medium such asthe memory 300, the process of controlling the display of images on thedisplay screen of the display device 400, and the process of executingdesired application software, for example. An example of the process ofrecording control involves “the process of transmitting the control dataincluding recording instructions and the data to be recorded to arecoding medium to the recording medium such as the memory 300.”Further, an example of the process of display control involves “theprocess of transmitting the control data including recordinginstructions and the data to be displayed on the display screen to adisplay device such as the display device 400.”

Also, the processor 200 may control the function of the image sensor 100by transmitting the control information thereto, for example. Theprocessor 200 may further control the data transmitted from the imagesensor 100 by sending the region designation information thereto, forexample.

(1-4) Image Sensor 100 (Transmission Apparatus)

The image sensor 100 has an imaging function and a transmission functionand thereby transmits data indicative of an image generated by imaging.As discussed above, the image sensor 100 acts as a transmissionapparatus in the communication system 1000.

Examples of the image sensor 100 include image sensor devices operatingby an appropriate method and capable of generating images, including “animaging device such as a digital still camera, a digital video camera,or a stereo camera,” “an infrared ray sensor,” and “a range imagesensor.” The image sensor 100 has the function of transmitting thegenerated data. The image generated by the image sensor 100 representsthe data indicative of the result of sensing by the image sensor 100. Aconfiguration example of the image sensor 100 will be discussed later.

Using the transmission method of the present embodiment, to be discussedlater, the image sensor 100 transmits the data corresponding to regionsset in the image (referred to as “region data” hereunder). Transmissionof the region data is controlled, for example, by a constituent element(to be discussed later) functioning as an image processing section ofthe image sensor 100. A region set in the image may be called an ROI(Region Of Interest) in some cases. In the description that follows, theregions set in the image may each be referred to as the “ROI.”

Examples of the processing related to the setting of regions in theimage include appropriate processes for identifying partial regions inthe image (or appropriate processes for clipping partial regions fromthe image), such as “the process of detecting an object from the imageand setting a region including the detected object” and “the process ofsetting the region designated by operation of a suitable operationdevice.”

The processing related to the setting of regions in the image may beperformed either by the image sensor 100 or by an external apparatussuch as the processor 200. In the case where the image sensor 100carries out the processing related to the setting of regions in theimage, the image sensor 100 identifies the regions according to theresult of the processing of setting regions in the image. Further, inthe case where an external apparatus performs the processing related tothe setting of regions in the image, for example, the image sensor 100identifies the regions on the basis of the region designationinformation acquired from the external apparatus.

When the image sensor 100 transmits the region data, i.e., when ittransmits the data representing portions of the image, the amount of thetransmitted data is made smaller than the amount of the datarepresenting the whole transmitted image. Thus, when the image sensor100 transmits the region data, the reduced amount of data providesvarious advantages such as a shorter transmission time and a reducedload of transmission by the communication system 1000, for example.

It is to be noted that the image sensor 100 is also capable oftransmitting the data indicative of the whole image.

In the case where the image sensor 100 has the function of transmittingthe region data and the function of transmitting the data indicative ofthe whole image, the image sensor 100 may be configured to selectivelyswitch between transmission of the region data and transmission of thewhole image data.

The image sensor 100 transmits either the region data or the whole imagedata depending on an established operation mode, for example. Theoperation mode is established by operation of an appropriate operationdevice, for example.

Alternatively, the image sensor 100 may selectively switch betweentransmission of the region data and transmission of the whole image dataon the basis of the region designation information acquired from anexternal apparatus. For example, when the region designation informationis acquired from the external apparatus, the image sensor 100 transmitsthe region data regarding the region corresponding to the acquiredregion designation information; when the region designation informationis not acquired from the external apparatus, the image sensor 100transmits the data indicative of the whole image.

The communication system 1000 has the configuration depicted in FIG. 1,for example. It is to be noted that the example in FIG. 1 is notlimitative of how the communication system of the present embodiment maybe configured.

For example, although the image sensor 100 is depicted as an example ofthe apparatus serving as a transmission apparatus in FIG. 1, theapparatus acting as the transmission apparatus is not limited to theimage sensor 100. Alternatively, in the case where the communicationsystem of the present embodiment includes an image sensor device such asan imaging device and a transmitter connected electrically with theimage sensor device, the transmitter may play the role of thetransmission apparatus.

Further, although the processor 200 is depicted as an example of theapparatus acting as a reception apparatus in FIG. 1, the apparatusoperating as the reception apparatus is not limited to the processor200. Alternatively, in the communication system of the presentembodiment, an appropriate device having the capability of receivingdata may play the role of the reception apparatus, for example.

In the case where the image transmitted from the image sensor 100 isstored onto a recording medium external to the communication system,where the image transmitted from the image sensor 100 is stored into amemory in the processor 200, or where the image transmitted from theimage sensor 100 is not recorded, the communication system of thepresent embodiment need not possess the memory 300.

Also, the communication system of the present embodiment may beconfigured without the display device 400 depicted in FIG. 1.

Further, the communication system of the present embodiment may beconfigured in a manner corresponding to the functions of electronicequipment, to be discussed later, in which the communication system ofthe present embodiment is employed.

Although the communication system has been explained in the precedingparagraphs as one embodiment of the present disclosure, the presentembodiment is not limitative of the present disclosure. Alternatively,the present disclosure may be implemented in the form of various typesof electronic equipment including a communication apparatus such as asmartphone, a drone (a device that can be operated remotely or can actautonomously), a mobile object such as a car, a computer such as a PC(Personal Computer), a tablet type apparatus, a game machine, and asurveillance camera.

Explained below is an outline of the operations of the communicationsystem for reducing the generation of motion blur, generation ofsaturated regions, and generation of reduced S/N ratio at the same time.

FIG. 5 is an explanatory diagram outlining the operations involved inchanging a frame exposure time in the case where a whole image istransmitted from the image sensor 100 to the processor 200. FIG. 5depicts a case in which the exposure time is shortened (to 1/480 secondsor less in the example of FIG. 5) for some frames. When the whole imageis transmitted from the image sensor 100 to the processor 200 in such amanner, the generation of a high-dynamic range image is subject toconstraints as discussed above.

FIG. 6 is an explanatory diagram outlining the operations involved inchanging the frame exposure time in the case where only some regions setin an image are transmitted from the image sensor 100 to the processor200. FIG. 6 depicts a case in which the exposure time is shortened (to1/480 seconds in the example of FIG. 6) for some frames and in whichmultiple data items (16 items in the example of FIG. 6) whose verticalsize measures 1/16 of that of each of these frames are transmitted. Thatis, in the present embodiment, the image sensor 100 is configured tohave at least two modes, i.e., one in which the whole captured region isread out and transmitted to the processor 200 and one in which setregions (ROI) are read out and transmitted to the processor 200.

When the data is transmitted as described above with the presentembodiment, it is possible to let the processor 200 generate ahigh-resolution image of partial regions in the image by transmission ofonly the partial regions in the image while the amount of thetransmitted data is kept the same as that of the whole transmittedimage.

(Image Sensor 100)

Explained below is a configuration example of the image sensor 100 ofthe present embodiment. FIG. 7 is a hardware block diagram depicting aconfiguration example of the image sensor 100 of the present embodiment.The image sensor 100 includes an image sensor device 102 and an IC chip104, for example. The image sensor 100 depicted in FIG. 7 operates onthe power supplied from an internal power supply such as a battery (notdepicted) constituting part of the communication system 1000, or on thepower supplied from a power source external to the communication system1000.

Examples of the image sensor device 102 include image sensor devicesoperating by an appropriate method and capable of generating images,including an “imaging device such as a digital still camera,” an“infrared ray sensor,” and a “range image sensor.”

For example, the imaging device functioning as the image sensor device102 includes a lens/imaging element and a signal processing circuit.

The lens/imaging element includes, for example, optical lenses and animage sensor that uses multiple imaging elements such as a CMOS(Complementary Metal Oxide Semiconductor) or a CCD (Charge CoupledDevice).

The signal processing circuit includes, for example, an AGC (AutomaticGain Control) circuit and an ADC (Analog to Digital Converter) andthereby converts an analog signal generated by the imaging element intoa digital signal (image data). Also, the signal processing circuitperforms various processes related to RAW phenomena, for example.Further, the signal processing circuit may carry out diverse signalprocessing such as White Balance adjustment, color correction, gammacorrection, YCbCr conversion, and edge enhancement.

Further, the signal processing circuit may perform processes related tothe setting of regions in an image and transmit the region designationinformation to the IC chip 104. Moreover, the signal processing circuitmay transfer diverse data including exposure information and gaininformation to the IC chip 104.

The signal indicative of the image generated by the image sensor device102 is transferred to the IC chip 104. It is to be noted that, in thecase where the signal representing the image transferred from the imagesensor device 102 to the IC chip 104 is an analog signal, the IC chip104 may let the internal ADC convert the analog signal to a digitalsignal, for example, and process the image data obtained by theconversion. The explanation below uses as an example the case in whichimage data is transferred from the image sensor device 102 to the ICchip 104.

The IC chip 104 is an IC (Integrated Circuit) that integrates circuitsrelated to the function of data transmission in the form of a chip. TheIC chip 104 processes the image data transferred from the image sensordevice 102, and transmits data corresponding to the image thusgenerated. The data corresponding to the image is constituted by theimage data transferred from the image sensor device 102 (i.e., dataindicative of the whole image) or by the region information and regiondata. It is to be noted that the circuits related to the function ofdata transmission are not limited to the implementation of a single ICchip. Alternatively, these circuits may be implemented in the form ofmultiple IC chips.

The IC chip 104 includes, for example, an image processing circuit 106,a LINK control circuit 108, an ECC generation circuit 110, a PHgeneration circuit 112, an EBD buffer 114, an image data buffer 116, acomposition circuit 118, and a transmission circuit 120.

The image processing circuit 106 is a circuit having the function ofperforming processes related to the transmission method of the presentembodiment. In a case of carrying out the processes related to thetransmission method of the present embodiment, the image processingcircuit 106 sets the region information for each of the lines making upan image, and causes the LINK control circuit 108, the ECC generationcircuit 110, the PH generation circuit 112, the EBD buffer 114, theimage data buffer 116, the composition circuit 118, and the transmissioncircuit 120 to transmit the set region information and the region datacorresponding to the regions involved, per line. Also, the imageprocessing circuit 106 may transmit for each line the image datatransferred from the image sensor device 102 (i.e., data indicative ofthe whole image).

An example of the image processing circuit 106 is a processor such as anMPU.

The functions possessed by the image processing circuit 106 areexplained below by dividing them into functional blocks. As depicted inFIG. 7, the image processing circuit 106 includes a region clippingsection 122, an image processing control section 124, and an encodingsection 126, for example.

The region clipping section 122 performs the process of setting regionsin an image. Given the image represented by the image data transferredfrom the image sensor device 102, the region clipping section 122 setsthe regions of interest (ROI). For example, the region clipping section122 performs the process of setting regions in the image depending on acurrently set operation mode. In the case of an operation mode in whichregion data is to be transmitted, for example, the region clippingsection 122 carries out the process of setting regions in the image. Inthe case of an operation mode in which the data indicative of the wholeimage is to be transmitted, the region clipping section 122 does notperform the process of setting regions in the image.

The region clipping section 122 detects objects from an image byperforming an appropriate object detection process on the image, forexample. For each of the detected objects, the region clipping section122 sets regions that include the detected object. The region clippingsection 122 may alternatively set regions designated by operation of anappropriate operation device.

In the case where regions are set, the region clipping section 122transmits to the image processing control section 124 the regiondesignation information designating the set regions, for example. In thecase where regions are not set, the region clipping section 122 does nottransmit any region designation information to the image processingcontrol section 124.

Also, the region clipping section 122 transmits to the encoding section126 the image data transferred from the image sensor device 102.

The image processing control section 124 performs processes related tothe transmission method of the present embodiment. The image processingcontrol section 124 sets the region information for each of the linesmaking up the image, and transmits the set region information to theencoding section 126 and to the PH generation circuit 112.

The image processing control section 124 identifies the region includedin each of the lines making up the image, on the basis of the regiondesignation information acquired from the region clipping section 122 orthe region designation information (not depicted) obtained from anexternal apparatus, for example. Further, on the basis of the identifiedregions, the image processing control section 124 sets the regioninformation for each line. At this point, as in the above-describedprocess of exception, the image processing control section 124 need notset as the region information the information that remains unchangedfrom information included in the region information regarding theimmediately preceding line to be transmitted.

In addition, in the case where the region designation information is notacquired, the image processing control section 124 does not set theregion information.

It is to be noted that the above-described processing is not limitativeof the processes performed by the image processing control section 124.

For example, the image processing control section 124 may, for example,generate frame information and transfer the generated frame informationto the LINK control circuit 108. An example of the frame information isa VC number assigned to each frame. Further, the frame information mayalso include data indicative of a data type such as YUV data, RGB data,or RAW data.

In another example, the image processing control section 124 may performthe process of setting additional information and transfer the setadditional information to the EBD buffer 114.

An example of the process of setting additional information is one inwhich the additional information is generated. Examples of the processof generating the additional information include at least the process ofgenerating information indicative of the amount of region data, theprocess of generating information indicative of region sizes, or theprocess of generating information indicative of the priorities ofregions.

It is to be noted that the process of setting additional information isnot limited to the process of generating the additional information.Alternatively, the image processing control section 124 may set as theadditional information the information acquired from the image sensordevice 102 such as exposure information and gain information. As anotheralternative, the image processing control section 124 may set as theadditional information various pieces of region-related data such asdata indicative of a physical region length, data indicative of anoutput region length, data indicative of an image format, and dataindicative of a total data amount. An example of the physical regionlength is the number of pixels of the image sensor device 102. Anexample of the output region length is the number of pixels in the image(length in the image) output from the image sensor device 102.

The encoding section 126 encodes, for example, the image datatransferred from the image sensor device 102 by using, for example, anappropriate method complying with a predetermined standard such as theJPEG (Joint Photographic Experts Group) standard.

In the case where the region information is not acquired from the imageprocessing control section 124, the encoding section 126 transfers theencoded image data to the image data buffer 116. In the description thatfollows, the encoded image data, i.e., the data indicative of theencoded whole image, may be referred to as “normal data.”

In addition, in the case where the region information is acquired fromthe image processing control section 124, the encoding section 126transfers to the image data buffer 116 the acquired region informationand the encoded region data indicative of the regions.

For example, with the region clipping section 122, the image processingcontrol section 124, and the encoding section 126 configured therein,the image processing circuit 106 performs processes related to thetransmission method of the present embodiment. It is to be noted thatthe functions of the image processing circuit 106 are divided into thefunctional blocks as depicted in FIG. 7 for reasons of expediency andthat this manner of dividing functions is not limitative of how thefunctions of the image processing circuit 106 may be divided.

The LINK control circuit 108 transfers, for example, the frameinformation for each line to the ECC generation circuit 110, to the PHgeneration circuit 112, and to the composition circuit 118.

The ECC generation circuit 110 sets an error-correcting code for eachline. On the basis of the data of each line in the frame information(e.g., VC number or data type), for example, the ECC generation circuit110 generates an error-correcting code for that line. For example, theECC generation circuit 110 transfers the generated error-correcting codeto the PH generation circuit 112 and to the composition circuit 118. TheECC generation circuit 110 may alternatively generate theerror-correcting code in coordination with the PH generation circuit112.

The PH generation circuit 112 generates a packet header for each line byuse of the frame information.

The PH generation circuit 112 may alternatively generate the packetheader on the basis of the region information transferred from the imageprocessing circuit 106 (image processing control section 124 in theexample of FIG. 7). Specifically, on the basis of the regioninformation, the PH generation circuit 112 sets, in the packet header,such data as “data indicating whether or not the information included inthe region information has changed from the region information includedin the immediately preceding packet to be transmitted” (changeinformation).

The EBD buffer 114 is a buffer that temporarily holds additionalinformation transferred from the image processing circuit 106 (imageprocessing control section 124 in the example of FIG. 7). The EBD buffer114 outputs the additional information to the composition circuit 118 as“Embedded Data” in a suitably timed manner. Incidentally, the “EmbeddedData” output from the EBD buffer 114 may be transferred to thecomposition circuit 118 by way of the image data buffer 116, to bediscussed later. In the case where the additional information (ROIinformation) to be transmitted has been recognized by the processor 200acting as a reception apparatus, registers may be set so as to skip thetransmission of EBD data corresponding to the additional informationfrom the transmission circuit 120, to be discussed later.

The image data buffer 116 is a buffer that temporarily holds data(normal data, or region information and region data) transferred fromthe image processing circuit 106 (encoding section 126 in the example ofFIG. 7). The image data buffer 116 outputs the retained data in asuitably timed manner to the composition circuit 118, per line.

The composition circuit 118 generates a transmitting packet on the basisof the data acquired from the ECC generation circuit 110, from the PHgeneration circuit 112, from the EBD buffer 114, and from the image databuffer 116, for example.

Given the packets transferred from the composition circuit 118, thetransmission circuit 120 transmits the packets per line over the databus B1 (an example of the signal transmission path, which applies to theensuing paragraphs) as transmitting data 147A. For example, thetransmission circuit 120 transmits the packets by use of the high-speeddifferential signal such as the one depicted in FIG. 4.

Explained hereunder are specific examples of data transmitted by theimage sensor 100 of the present embodiment. FIG. 8 is an explanatorydiagram depicting one specific example of the data transmitted by theimage sensor 100 of the present embodiment.

In FIG. 8, “FS” stands for an FS (Frame Start) packet according to theMIPI CSI-2 standard. Also in FIG. 8, “FE” stands for an FE (Frame End)packet according to the MIPI CSI-2 standard (both acronyms areapplicable to other drawings as well).

In FIG. 8, “Embedded Data” denotes data that can be embedded in thepackets to be transmitted. For example, “Embedded Data” can be embeddedin the header, payload, or footer of the packets to be transmitted. Inthe example of FIG. 8, region information is stored in the “EmbeddedData” of one packet, and the “Embedded Data” with the region informationstored therein represents additional data.

The present embodiment transmits two types of information: informationin the form of “Embedded Data” indicative of a region size; andinformation indicating how many transmitting frames continue for theregion of interest. When the information in the form of “Embedded Data”depicted in FIG. 8 indicating the region size and the informationindicating how many transmitting frames continue for the region ofinterest are transmitted, the processor 200 can identify as many as n(16 in the example of FIG. 8) minimum rectangular regions including aminimum rectangular region indicated by t=0, a minimum rectangularregion indicated by t=1, and so on up to a minimum rectangular regionindicated by t=15 that are depicted in FIG. 8. That is, even if theprocessor 200 has neither the function of identifying the minimumrectangular regions including the above regions on the basis of theregion information nor the function of identifying how many transmittingframes continue for the region of interest, the transmission of both theinformation in the form of “Embedded Data” depicted in FIG. 8 indicativeof the region size and the information indicating how many transmittingframes continue for the region of interest enables the processor 200 toidentify the minimum rectangular regions including the above regions onthe basis of the region information and also to identify how manytransmitting frames continue for the region of interest. It is to benoted that, obviously, the information indicative of the region size isnot limited to the data indicating the minimum rectangular regionsincluding the above regions.

Obviously, the above examples of the information transmitted in the formof “Embedded Data” depicted in FIG. 8 indicative of the amount of theregion data, the information indicative of the region size, and theinformation indicating how many transmitting frames continue for theregion of interest that are depicted in FIG. 8 are not limitative ofsuch types of information. Furthermore, not all of such pieces ofinformation need to be transmitted.

First, in the case where a whole image is transmitted from the imagesensor 100, the image data per frame is set in Payload Data whentransmitted. In the example of FIG. 8, one image is divided verticallyinto 16 portions, and the image data is stored in the Payload Data ofeach divided line. Obviously, the number of divisions in the verticaldirection per frame is not limited to the number of this example.

Next, in the case where partial regions in the image are transmittedfrom the image sensor 100, such as where 16 images numbered 0 to 15 with1/16 size each in the vertical direction, are transmitted as depicted inFIG. 6, the data items numbered 0 to 15 are stored in the Payload Data.This enables the image sensor 100 to transmit multiple images with ashort exposure time each in the same amount of data as when the wholeimage is transmitted.

Given the region size data and the information indicating that the wholescreen continues to be transmitted for as long it takes to transfer oneframe in the “Embedded Data,” the processor 200 acting as the receptionapparatus can acquire the information indicative of the number ofcontinuously transferred frames for the region of interest, based on thecontent of the “Embedded Data,” even if there is no explicit informationindicating how many frames are continuously transferred for that region.

The above example is not limitative of examples of the data transmittedfrom the image sensor 100. FIG. 9 is an explanatory diagram depictinganother specific example of the data transmitted by the image sensor 100of the present embodiment. The example depicted in FIG. 9 is a specificexample in which 16 images numbered 0 to 15 with 1/16 size each in thevertical direction are transmitted. What is different from the examplein FIG. 8 is that the data of each image starts with an “FS” packet andends with an “FE” packet when transmitted. In this example, each of theimages numbered 0 to 15 is transmitted with the “Embedded Data,” so thatthe amount of the data involved is slightly larger than that in theexample depicted in FIG. 8. Still, the amount of the Payload Dataremains the same as in the example of FIG. 8. It follows that the imagesensor 100 can transmit multiple images with a short exposure time eachin approximately the same data amount as when the whole image istransmitted.

(Processor 200)

The processor 200 is explained next. FIG. 10 depicts a configurationexample of the processor 200 of the present embodiment. The processor200 is an apparatus that receives signals according to the same standardas that of the image sensor 100 (e.g., MIPI CSI-2 standard, MIPI CSI-3standard, or MIPI DSI standard). The processor 200 includes a receptionsection 210 and an information processing section 220, for example. Thereception section 210 is a circuit that receives the transmitting data147A output from the image sensor 100 via a data lane DL and performspredetermined processes on the received transmitting data 147A, therebygenerating diverse data (214A, 215A, and 215B) and transmitting thegenerated data to the information processing section 220. Theinformation processing section 220 is a circuit that generates an ROIimage 223A on the basis of the diverse data (214A and 215A) receivedfrom the reception section 210, or generates a normal image 224A on thebasis of the data (215B) received from the reception section 210.

The reception section 210 includes a header separation section 211, aheader interpretation section 212, a Payload separation section 213, anEBD interpretation section 214, and an ROI data separation section 215,for example.

The header separation section 211 receives the transmitting data 147Afrom the image sensor 100 via the data lane DL. That is, the headerseparation section 211 receives the transmitting data 147A that includesROI information regarding the regions ROI set in the image captured bythe image sensor 100, the transmitting data 147A further having theimage data of each region ROI included in the Payload Data in a LongPacket. The header separation section 211 separates the receivedtransmitting data 147A into a frame header region and a packet region.The header interpretation section 212 identifies the position of thePayload Data in the Long Packet included in the packet region, on thebasis of data (specifically, the Embedded Data) included in the frameheader region. The Payload separation section 213 separates the PayloadData in the Long Packet included in the packet region from the packetregion on the basis of the Payload Data position in the Long Packetidentified by the header interpretation section 212. In addition, in thecase where the processor has recognized the additional information (ROIinformation) included in the EBD data or in the Long Packet, forexample, it is possible to skip the transmission of part or all of theROI information. Specifically, the processor causes the headerinterpretation section 212 to retain the information corresponding tothe EBD data and, on the basis of the retained information, identifiesthe Payload Data position in the Long Packet included in the packetregion.

The EBD interpretation section 214 outputs the Embedded Data as EBD data214A to the information processing section 220. Further, from the datatype included in the Embedded Data, the EBD interpretation section 214determines whether the image data included in the Payload Data in theLong Packet is compressed image data derived from ROI image data orcompressed image data derived from normal image data. The EBDinterpretation section 214 outputs the result of the determination tothe ROI data separation section 215.

In the case where the image data included in the Payload Data in theLong Packet is the compressed image data derived from ROI image data,the ROI data separation section 215 regards the Payload Data in the LongPacket as Payload Data 215A and outputs the Payload Data 215A to theinformation processing section 220 (specifically, the ROI decodingsection 222). In the case where the image data included in the PayloadData is the compressed image data derived from normal image data, theROI data separation section 215 regards the Payload Data in the LongPacket as Payload Data 215B and outputs the Payload Data 215B to theinformation processing section 220 (specifically, the normal imagedecoding section 224). In the case where the ROI information is includedin the Payload Data in the Long Packet, the Payload Data 215A includesthe ROI information and one-line pixel data out of the compressed imagedata.

The information processing section 220 extracts the ROI information fromthe Embedded Data included in the EBD data 214A. On the basis of the ROIinformation extracted by the information extraction section 221, theinformation processing section 220 extracts an image of each region ofinterest ROI in the captured image from the Payload Data in the LongPacket included in the transmitting data received by the receptionsection 210. For example, the information processing section 220includes an information extraction section 221, an ROI decoding section222, an ROI image generation section 223, a normal image decodingsection 224, and a memory 225.

The normal image decoding section 224 generates the normal image 224A bydecoding the Payload Data 215B. The ROI decoding section 222 generatesimage data 222A by decoding the compressed image data 147B included inthe Payload Data 215A. The image data 222A includes one or multipletransmitting images.

The information extraction section 221 extracts the ROI information fromthe Embedded Data included in the EBD data 214A. The informationextraction section 221 extracts, for example, the number of regions ofinterest ROI included in the captured image, the region number of eachregion of interest ROI, the data length of each region of interest ROI,and the image format of each region of interest ROI from the EmbeddedData included in the EBD data 214A.

On the basis of the ROI information obtained by the informationextraction section 221, the ROI image generation section 223 generatesan image of each region of interest ROI in the captured image. The ROIimage generation section 223 outputs the generated image as an ROI image223A.

The memory 225 temporarily stores the ROI image generated by the ROIimage generation section 223. Upon generating an ROI image, the ROIimage generation section 223 performs the process of image compositionwith use of the ROI image stored in the memory 225. This allows the ROIimage generation section 223 to generate the ROI image with a reducedmotion blur.

Whereas FIG. 6 depicts the example in which images of which the verticalsize is 1/16 of that of the whole image are transmitted, what isdescribed below is another example. FIG. 11 is an explanatory diagramoutlining the operations involved in changing the frame exposure time inthe case where only the region set in an image is transmitted from theimage sensor 100 to the processor 200. FIG. 11 depicts an example inwhich the exposure time is shortened (to 1/480 seconds in the example ofFIG. 11) for some frames and in which what is transmitted in theseframes are multiple data items (16 in the example of FIG. 11) of whichthe vertical size and the horizontal size are ¼ each of the whole image.

FIG. 12 is another explanatory diagram outlining the operations involvedin changing the frame exposure time in the case where only the regionsset in an image are transmitted from the image sensor 100 to theprocessor 200. FIG. 12 depicts an example in which the exposure time isshortened (to 1/240 seconds in the example of FIG. 12) for some framesand in which what is transmitted in these frames are multiple data items(8 in the example of FIG. 12) of which the vertical size and thehorizontal size are ⅛ and ¼ of the whole image respectively, as well asmultiple data items (8 in the example of FIG. 12) of which the verticalsize and the horizontal size are 1/16 and ½ of the whole imagerespectively. That is, either the exposure time may be determinedaccording to the size of the regions read out by the image sensor 100,or the size of the regions read out by the image sensor 100 may bedetermined according to the exposure time (or frame rate) of the imagesensor 100. For example, the ROI image generation section 223 may eitherdetermine the frame rate of the image sensor 100 in keeping with thesize of the ROI image to be generated, or determine the size of the ROIimage in keeping with the frame rate of the image sensor 100.

FIG. 13 is an explanatory diagram depicting another specific example ofdata transmitted by the image sensor 100 of the present embodiment whenthe transmission explained above in conjunction with FIG. 12 isimplemented. In the case where the image sensor 100 transmits eightimages numbered 0 to 7 of the two regions found in FIG. 12, data itemsnumbered 0 to 7 are stored in the Payload Data. This enables the imagesensor 100 to transmit multiple images of a short exposure time each inthe same data amount as that in the case where the whole image istransmitted.

When returning from the frames for transmitting partial regions to theframes for transmitting all regions, the image sensor 100 may use twoexposure times mixedly, i.e., a short exposure time for the partialregions and a long exposure time for the regions not designated as thepartial regions. By carrying out the exposure in the mixed manner, theimage sensor 100 can perform an approximately uniform exposure for thewhole screen starting from the first frame after the return.

FIG. 14 is another explanatory diagram outlining the operations involvedin changing the exposure time of frames in the case where only theregions set in an image are transmitted from the image sensor 100 to theprocessor 200. FIG. 14 depicts an example in which the exposure time isshortened (to 1/240 seconds in the example of FIG. 14) for some framesand in which what are transmitted in these frames are multiple dataitems (8 in the example of FIG. 14) of which the vertical size and thehorizontal size are ⅛ and ¼ of the whole image respectively as well asmultiple data items (8 in the example of FIG. 14) of which the verticalsize and the horizontal size are 1/16 and ½ of the whole imagerespectively.

Here, in an (n+1)th frame, two exposure times coexist mixedly, i.e., ashort exposure time for partial regions and a long exposure time for theregions not designated as the partial regions. Upon receipt of thetransmission from the image sensor 100, the processor 200 combines theresult of the short-time exposure for the partial regions with theresult of the exposure for the remaining regions, thereby performing anapproximately uniform exposure for the whole screen starting from thefirst frame after the return.

Another example is described below. FIG. 15 is another explanatorydiagram outlining the operations involved in changing the exposure timeof frames in the case where only the region set in an image istransmitted from the image sensor 100 to the processor 200. FIG. 15depicts an example in which the exposure time is shortened (to 1/480seconds the example of FIG. 15) for some frames and in which what istransmitted in these frames are multiple data items (16 in the exampleof FIG. 15) of which the vertical size and the horizontal size are ⅛ and½ of the whole image respectively.

Also in this case, in the (n+1)th frame, two exposure times coexistmixedly, i.e., a short exposure time for a partial region and a longexposure time for the regions not designated as the partial region. Uponreceipt of the transmission from the image sensor 100, the processor 200combines the result of the short-time exposure for the partial regionwith the result of the exposure for the remaining regions, therebyperforming an approximately uniform exposure for the whole screenstarting from the first frame after the return.

The image sensor 100 can read out multiple regions simultaneously bypossessing multiple circuits each reading out data from the image sensordevice 102. FIG. 16 is another explanatory diagram outlining theoperations involved in changing the exposure time of frames in the casewhere only the regions set in an image are transmitted from the imagesensor 100 to the processor 200. FIG. 16 depicts an example in which theexposure time is shortened (to 1/480 seconds in the example of FIG. 16)for some frames and in which what is transmitted in these frames are twoportions of multiple data items (16 in the example of FIG. 16) of whichthe vertical size and the horizontal size are ¼ and ⅛ of the whole imagerespectively.

The image sensor 100 can change the region to be read out in units offrames. For example, suppose that the processor 200 (or an apparatusdownstream of the processor 200) detects a mobile object in a partialregion of a given frame. In that case, the processor 200 (or anapparatus downstream of the processor 200) may designate for the imagesensor 100 only the region that includes the mobile object, from thenext frame on in order to acquire the motion of the detected mobileobject in a more detailed manner.

FIG. 17 is another explanatory diagram outlining the operations involvedin changing the exposure time of frames in the case where only theregions set in an image are transmitted from the image sensor 100 to theprocessor 200. FIG. 17 depicts an example in which the exposure time isshortened (to 1/480 seconds in the example of FIG. 17) for some framesand in which what is transmitted in these frames are two portions ofmultiple data items (16 in the example of FIG. 17) of which the verticalsize and the horizontal size are both ¼ of the whole image.

After detecting a mobile object in a given frame, the processor 200 (oran apparatus downstream of the processor 200) instructs the image sensor100 to further shorten the exposure time (to 1/1920 seconds in theexample of FIG. 17) for the next frame. Also, the processor 200 (or anapparatus downstream of the processor 200) instructs the image sensor100 to read from the frame an image of which the vertical size and thehorizontal size are both ⅛ of the whole image as well as an image ofwhich the vertical size and the horizontal size are 1/16 and ¼ of thewhole image respectively.

The image sensor 100 of the present embodiment of the present disclosurecaptures and generates a high-quality moving image of high sensitivityin the high dynamic range by carrying out the exposure of partialregions. Here, any suitable method of region designation may be adopted.For example, the processor 200 (e.g., the ROI image generation section223) may calculate region information data constituting the region sizeinformation and transmit the result of calculation of the regioninformation data to the image sensor 100 in order to designate theregions to be exposed. Here, the region information data may include thewidth, height, and coordinates of each region to be exposed.

Explained below is a typical data format for ROI regions. FIG. 18 is anexplanatory diagram depicting an example of ROI regions. It is assumed,for example, that there are four ROI regions A to D as depicted in FIG.18. FIG. 19 is an explanatory diagram depicting an example of the dataformat for ROI regions.

“PH” stands for a packet header. “Embedded Data” denotes data that canbe embedded in packets to be transmitted. The “Embedded Data” may atleast include ID identifying an ROI region, position informationrepresenting the top-left coordinates of the ROI region, and the heightand width of the ROI region. In the format depicted in FIG. 19, thethird and subsequent lines store the actual data of the ROI region. Inthe case where ROI regions overlap with each other, as in the case ofregions A and B of FIG. 18, the data of an overlapping region is storedonly once.

What follows is an explanation of another example of the structure ofpackets for use in transmitting images from the image sensor 100(transmission apparatus) to the processor 200 (reception apparatus) inthe communication system embodying the present disclosure. In thecommunication system of the present embodiment, the image captured bythe image sensor 100 is divided into partial images in units of lines;the data of the partial image of each line is transmitted by use of atleast one packet. The same applies to the region data of the regions setin the image (i.e., data of partial images with ROI set therein).

For example, FIG. 20 is an explanatory diagram depicting a structuralexample of packets for use in the transmission of image data by thecommunication system of the present embodiment. As depicted in FIG. 20,a packet for use in the transmission of images is defined as a series ofdata that starts with a Start Code and ends with an End Code in a datastream. The packet also includes a header and payload data arranged inthat order. The payload data may be suffixed with a footer. The payloaddata (or simply referred to as the payload hereunder) includes pixeldata of a partial image of each line. The header includes diverseinformation regarding the line corresponding to the partial imageincluded in the payload. The footer includes additional information(option).

Explained hereunder is the information included in the header. Asdepicted in FIG. 20, the header includes “Frame Start,” “Frame End,”“Line Valid,” “Line Number,” “EBD Line,” “Data ID,” “Reserved,” and“Header ECC,” in that order.

The Frame Start is one-bit information indicative of the start of aframe. For example, a value of 1 is set in the Frame Start of the headerof a packet for use in transmitting the pixel data of the first line inthe image data targeted for transmission. A value of 0 is set in theFrame Start of the header of a packet for use in transmitting the pixeldata of any other line. Incidentally, the Frame Start represents anexample of “information indicative of the start of a frame.”

The Frame End is one-bit information indicative of the end of a frame.For example, the value 1 is set in the Frame End of the header of apacket having the payload that includes the pixel data of the end lineof an effective pixel region out of the image data targeted fortransmission. The value 0 is set in the Frame End of the header of apacket for use in transmitting the pixel data of any other line.Incidentally, the Frame End represents an example of “informationindicative of the end of a frame.”

The Frame Start and the Frame End represent an example of FrameInformation which is information regarding the frame.

The Line Valid is one-bit information indicative of whether or not theline of the pixel data stored in the payload is a line of effectivepixels. The value 1 is set in the Line Valid of the header of a packetfor use in transmitting the pixel data of a line within the effectivepixel region. The value 0 is set in the Line Valid of the header of apacket for use in transmitting pixel data of any other line.Incidentally, the Line Valid represents an example of “informationindicative of whether or not the corresponding line is effective.”

The Line Number is 13-bit information indicative of the line number ofthe line including the pixel data stored in the payload.

The EBD Line is one-bit information indicative of whether or not this isa line having embedded data. That is, the EBD Line represents an exampleof “information indicative of whether or not this line is a line havingembedded data.”

The Data ID is four-bit information for identifying each of the dataitems making up data (i.e., data included in the payload) in the casewhere the data is transferred in multiple streams. Incidentally, theData ID represents an example of “information identifying the dataincluded in the payload.”

The Line Valid, the Line Number, the EBD Line, and the Data IDconstitute Line Information which is information regarding the lines.

The Reserved is a 27-bit region for extension purposes. It is to benoted that, in the description that follows, the region indicated asReserved may also be referred to as an “extension.” The data of theheader information as a whole amounts to six bytes.

As depicted in FIG. 20, a Header ECC disposed subsequent to the headerinformation includes a CRC (Cyclic Redundancy Check) code, which is atwo-byte error-detecting code calculated on the basis of the six-byteheader information. That is, the Header ECC represents an example of an“error-correcting code for the information included in the header.”Also, the Header ECC includes two sets of the same information aseight-byte information constituting a combination of the headerinformation and CRC code, following the CRC code.

That is, the header of a single packet includes three combinations ofthe same header information and CRC code. The data amount of the entireheader is 24 bytes made up of a first eight-byte combination of theheader information and CRC code, a second eight-byte combination of theheader information and CRC code, and a third eight-byte combination ofthe header information and CRC code.

Explained hereunder with reference to FIGS. 21 and 22 is an extension(Reserved) set in the header of the packet. FIGS. 21 and 22 areexplanatory diagrams explaining the extension provided in the packetheader.

As depicted in FIG. 21, in the extension, the first three bits are setwith the type of header information (Header Info Type) corresponding tothe information to be transmitted in the packet. In the extension, theheader information type determines the format of the information (i.e.,the format includes the information type and the position in which theinformation is set) to be set in the remaining 24-bit region excludingthe three bits in which the header information type is set. This allowsthe receiving side to verify the header information type. Verificationof the header information type enables the receiving side to recognize,within the extension, specific information set in specific positionsoutside the region in which the header information type is designated.This makes it possible to read the set information.

For example, FIG. 22 depicts how the header information type istypically set and how a variable payload length (i.e., variable linelength) of the packet is typically set as one way of using the extensioncorresponding to the setting of the header information type.Specifically, in the example in FIG. 22, the header information type isset with the value corresponding to the case where the payload length isvariable. More specifically, in the example in FIG. 22, the headerinformation type is set with a value “001,” which is different from thevalue “000” set for the header information type in the example in FIG.21. That is, in this case, the header information type corresponding tothe value “001” signifies the type in the case where the payload lengthis variable. Also in the example in FIG. 22, 14 bits in the extensionare assigned to “Line Length.” The “Line Length” is information fornotification of the payload length. Such structure allows the receivingside to recognize that the payload length is variable, on the basis ofthe value set as the header information type. Also, the receiving sidecan recognize the payload length by reading the value set as the “LineLength” in the extension.

Explained above with reference to FIGS. 20 to 22 is one structuralexample of the packets for use in transmitting images from the imagesensor 100 (transmission apparatus) to the processor 200 (receptionapparatus) in the communication system of the present embodiment.

What follows is a description of a typical transmission method fortransmitting the region data of a region (ROI) set in an image, themethod being one technical feature of the communication system of thepresent embodiment.

The image sensor 100 stores the region data of the region set in animage into the payload of packets for line-by-line transmission. In theensuing description, that portion of the region which is set in theimage and which corresponds to each line may be referred to as a“partial region” for reasons of expediency.

(Data Format)

First, FIG. 23 is an explanatory diagram explaining the format of thedata for transmission. In FIG. 23, a series of packets indicated byreference sign A1 represents schematically the packets in which theregion data of the region set in an image is transmitted (i.e., thepackets for transmitting the data of an effective pixel region). Seriesof packets indicated by reference signs A2 and A3 represent the packetsdifferent from those for transmitting the region data. It is to be notedthat, in the description that follows, where the packets indicated byreference signs A1, A2, and A3 are to be distinguished from one another,the packets may be referred to as “packets A1,” “packets A2,” and“packets A3” for reasons of expediency. That is, in the period duringwhich the data of one frame is transmitted, a series of packets A2 istransmitted before transmission of a series of packets A1. A series ofpackets A3 may be transmitted after transmission of the series ofpackets. At least either the packets A2 or the packets A3 represent anexample of “first packets.” The packets A2 represent an example of“second packets.”

In the example in FIG. 23, at least part of the series of packets A2 isused for transmitting the Embedded Data. For example, the Embedded Datamay be stored in the payload of the packets A2 when transmitted. Inanother example, the Embedded Data may be stored in regions differentfrom the payload of the packets A2 when transmitted.

The Embedded Data corresponds to additional information transmittedadditionally from the image sensor 100 (i.e., the information embeddedby the image sensor 100). Examples of the Embedded Data includeinformation regarding the conditions for image capture and informationregarding the regions (ROI) of which the region data is transmitted.

Although at least part of the packets A2 is used for transmitting theEmbedded Data in the example in FIG. 23, the packets A2 mayalternatively be replaced with at least part of the packets A3 intransmitting the Embedded Data. In the ensuing description, the EmbeddedData may be referred to as “EBD.”

In FIG. 23, “SC” stands for “Start Code.” This is a group of symbolsindicative of the start of a packet. The Start Code is prefixed to thepacket. For example, the Start Code is represented by four symbols,i.e., by a combination of three K Characters K28.5, K27.7, K28.2, andK27.7.

“EC” stands for “End Code.” This is a group of symbols indicative of theend of a packet. The End Code is suffixed to the packet. For example,the End Code is represented by four symbols, i.e., by a combination ofthree K Characters K28.5, K27.7, K30.7, and K27.7.

“PH” stands for “Packet Header.” For example, the header explained abovewith reference to FIG. 2 corresponds to the Packet Header. “FS” denotesan FS (Frame Start) packet. “FE” denotes an FE (Frame End) packet.

“DC” stands for “Deskew Code.” This is a group of symbols used forcorrecting Data Skew between lanes, i.e., for correcting the skewedtiming of the data received by the receiving side in each lane. Forexample, the Deskew Code is represented by four symbols of K28.5 andAny**.

“IC” stands for “Idle Code.” This is a group of symbols transmittedrepeatedly in periods except during the transmission of packets. Forexample, the Idle Code is represented by D Character D00.0 (00000000),which is an 8B10B Code.

“DATA” denotes the region data stored in the payload (i.e., pixel dataof the portions corresponding to the regions set in the image).

“XY” represents information that indicates, in X and Y coordinates, theleftmost position of the partial region (in the image) corresponding tothe region data stored in the payload. It is to be noted that, in thedescription that follows, the X and Y coordinates represented by “XY”and indicative of the leftmost position of the partial region may simplybe referred to as “XY coordinates of the partial region.”

The XY coordinates of the partial region are stored at the beginning ofthe payload of the packets A1. In the case where there is no change inthe X coordinate of the partial region corresponding to each of thecontinuously transmitted packets A1 and where the Y coordinate isincremented by only 1 from one packet to another, the XY coordinates ofthe partial region may be omitted from the subsequently transmittedpacket A1. It is to be noted that this aspect of control will bediscussed later using a specific example.

With this transmission method, in the case where multiple regions areset in a line in a manner separated from each other horizontally andwhere the region data of a partial region corresponding to each of themultiple regions is transmitted, a packet A1 for each of the multipleregions is generated separately and transmitted. That is, for each linein which two regions are set to be separated from each otherhorizontally, two packets A1 are generated and transmitted.

Described below with reference to FIG. 24 is a structural example of thepacket header of the packet A1 for transmitting the region data of aregion (ROI) set in an image, with emphasis on the structure of theextension. FIG. 24 is an explanatory diagram explaining one structuralexample of the packet header.

As depicted in FIG. 24, in the case where the region data of the region(ROI) set in the image is transmitted with this transmission method, theinformation indicating the transmission of region information is set asthe header information type (i.e., information corresponding to the typetargeted for transmitting the region information) in the packet headerof the packet A1 used for transmitting the region data. Also, at least aportion of the extension is set with information indicative of thetransmission of the region data (i.e., region data of the partialregion) by use of the payload. In addition, in the case where thepayload is used to transmit the region coordinates (i.e., XY coordinatesof the partial region), at least a portion of the extension is set withinformation indicative of the transmission of the region coordinates. Itis to be noted that, in the case where the region data of the region(ROI) set in the image is transmitted, the payload length of the packetA1 may vary depending on the horizontal width of the region. For thisreason, as in the example explained above with reference to FIG. 22, aportion of the extension may be set with information indicative of thepayload length.

2. Conclusion

When the communication system 1000 embodying the present disclosure isconfigured and operated as described above, the communication system1000 is able to suppress the generation of motion blur, generation ofsaturated regions, and generation of reduced S/N ratio at the same time.By simultaneously suppressing the generation of motion blur, generationof saturated regions, and generation of reduced S/N ratio, thecommunication system 1000 embodying the present disclosure can captureand generate a high-quality moving image of high sensitivity in the highdynamic range.

Because the communication system 1000 embodying the present disclosuresuppresses the generation of motion blur, generation of saturatedregions, and generation of reduced S/N ratio simultaneously, thecommunication system 1000 is able to selectively shorten the exposuretime solely for the region of interest in order to perform the output ata high frame rate while keeping the output data rate constant.

Because the communication system 1000 embodying the present disclosuresuppresses the generation of motion blur, generation of saturatedregions, and generation of reduced S/N ratio simultaneously, thecommunication system 1000 is able to selectively shorten the exposuretime solely for the region of interest and thereby boost the frame rateby an amount reflecting the shortened exposure time while performing theoutput. Thus, even if the exposure time for a given frame of the imagein the image sensor is shortened, so that the frame image may fall shortin sensitivity when evaluated, the frame rate is boosted by an amountreflecting the shortened exposure time, which increases the number ofexposed frames. This makes it possible to obtain through signalprocessing the image output from the image sensor with approximately thesame sensitivity as in the case where the exposure time is notshortened.

For example, even if sensitivity is insufficient with an exposure timeof 1/30 seconds for a conventional method and where sensitivity isinsufficient with an exposure time of 1/480 seconds, the presentembodiment permits acquisition of 16 images within the time of 1/30second, each of the images being obtained with the exposure time of1/480 seconds. The embodiment is thus able to easily reproduce the imagethat used to be obtained with the exposure time of 1/30 seconds, bysimply adding up the 16 images each obtained with the exposure time of1/480 seconds.

In addition, the communication system 1000 embodying the presentdisclosure is capable of signal processing using a relatively smallnumber of plural images with relatively little motion blur andrelatively limited motion deviation (i.e., using 16 images each obtainedwith the exposure time of 1/480 seconds in the above example). Since amobile object moves in space over time (i.e., within the image), simplyadding up the 16 images would reproduce the original motion blur. On theother hand, in the case where the image is acquired with the exposuretime of 1/480 seconds, the difference in time between two frames is arelatively short time of 1/480 seconds in addition to the fact that eachof the images is obtained with the relatively short exposure time of1/480 seconds. It follows that the amount by which a mobile object movesbetween two consecutive frames is relatively small. This allows thecommunication system 1000 embodying the present disclosure to easilyperform motion compensation on each of the mobile objects before addingup the images involved. The communication system 1000 is thus able todeal with insufficient sensitivity and motion blur at the same time.

With a conventional method, for example, even in the case of approximateexposure with the exposure time of 1/30 seconds, there may occur apartially saturated region. With the present embodiment, by contrast, 16images each captured with the exposure time of 1/480 seconds may beobtained within the time of 1/30 seconds. When adding up the 16 imagesthus obtained, the communication system 1000 embodying the presentdisclosure maintains sufficient gradation without causing a saturationstate, thereby turning the images acquired with the exposure time of1/30 seconds easily into a high-dynamic range image with no saturation.

Some advantageous effects of the communication system 1000 embodying thepresent disclosure are explained below.

It is assumed that the time required to transfer the data of all pixelsof the image sensor 100 to the processor 200 located downstream is aone-frame time. On this assumption, an ROI region is exposed in 1/n ofthe one-frame time (n is any integer of at least 2). Thus, for eachimage, the signal amount is 1/n times and the shot noise is 1/(n)^(1/2)times, worsening the S/N ratio. In a subsequent stage, however, as manyas n images are added up, so that the signal amount is 1/n×n=1 times andthe shot noise is ((1/(n)^(1/2))²×n)^(1/2)=1 times. The communicationsystem 1000 embodying the present disclosure is thus able to acquire theadded images without deterioration of the S/N ratio.

On the other hand, a region that has conventionally been saturated inthe image following the one-frame time exposure is acquired with anexposure of 1/n times the one-frame time period. The communicationsystem 1000 embodying the present disclosure is thus able to acquire,without saturation, subjects that are up to n times brighter.

The communication system 1000 embodying the present disclosure furtherprovides an advantageous effect of reducing the amount of blur of amoving subject to 1/n.

In addition, by not carrying out the above-mentioned process of addingup n images in a region detected to be in motion, the communicationsystem 1000 embodying the present disclosure is able to acquire amotionless object without worsening its S/N ratio while reducing theamount of blur of a detected mobile object to 1/n.

Moreover, the communication system 1000 embodying the present disclosureperforms the adding process on the mobile object portion while carryingout motion compensation, thereby acquiring not only the motionlessobject but also the mobile object portion without deterioration of theS/N ratio while keeping the amount of blur of the mobile object reducedto 1/n.

Whereas the preferred embodiment of the present disclosure has beendescribed above in detail with reference to the accompanying drawings,the embodiment is not limitative of the technical scope of the presentdisclosure. It is obvious that those skilled in the art will easilyconceive of variations or alternatives of the disclosure within thescope of the technical idea stated in the appended claims. It is to beunderstood that such variations, alternatives, and other ramificationsalso fall within the technical scope of the present disclosure.

The advantageous effects stated in the present description are only forillustrative purposes and are not limitative of the present disclosure.That is, in addition to or in place of the above-described advantageouseffects, the technology of the present disclosure may provide otheradvantageous effects that will be obvious to those skilled in the art inview of the above description.

For example, part or all of the constituent elements of the circuitsconstituting the image sensor 100 and the processor 200 needed for ROIprocessing and depicted in FIGS. 7 and 10 may be included either in theimage sensor 100 or in the processor 200. Also, part or all of theconstituent elements of the circuits making up the image sensor 100 andthe processor 200 depicted in FIGS. 7 and 10 may be configured either inhardware or in software. Upon inclusion in the image sensor 100, theimage sensor 100 and the processor 200 may be configured in modularform.

As another example, whereas the processor 200 configured as depicted inFIG. 10 outputs the ROI image and the normal image separately, this isnot limitative of the present disclosure. Alternatively, the processor200 may provide the ROI image and the normal image in the same output.

It is to be noted that the following configurations also fall within thetechnical scope of the present disclosure.

(1)

A reception apparatus including:

a reception section configured to receive image data at least either ina first mode for receiving the image data of a whole captured region orin a second mode for receiving the image data of only a partial regionin the captured region; and

an information processing section configured to generate an image, basedon the image data received by the reception section,

in which, at the time of image data receipt in the second mode, theinformation processing section receives image data to which a parameterdifferent from that in the first mode is added.

(2)

The reception apparatus as stated in paragraph (1) above, in which theinformation processing section generates an image, by combining pluralimages of the image data received in the second mode, in a mannerreflecting an exposure time of the image data.

(3)

The reception apparatus as stated in paragraph (2) above, in which theexposure time is determined in keeping with a size of the region at atime of data receipt in the second mode.

(4)

The reception apparatus as stated in paragraph (2) above, in which theinformation processing section determines the number of images to becombined of the image data received in the second mode, on the basis ofinformation regarding the number of frames over which the second mode iscontinued, the information being included in the parameter.

(5)

The reception apparatus as stated in any one of paragraphs (1) to (4)above, in which the size of the region in the second mode is determinedby an exposure time in the second mode and by an exposure time in thefirst mode.

(6)

The reception apparatus as stated in any one of paragraphs (1) to (5)above, in which the information processing section outputs informationregarding a size of the region in the second mode to an imagingapparatus.

(7)

The reception apparatus as stated in any one of paragraphs (1) to (6)above, in which the information processing section uses the region readout in the second mode and any other regions than that region whengenerating the image in the first mode in a frame immediately followingreadout in the second mode.

(8)

The reception apparatus as stated in any one of paragraphs (1) to (7)above, in which the reception section receives a transmitting signal inwhich a payload part of a packet includes the image data and in which apredetermined header part includes the parameter.

(9)

The reception apparatus as stated in paragraph (8) above, in which theinformation processing section extracts region information regarding theregion from the header part included in the transmitting signal receivedby the reception section, the information processing section furtherextracting, on the basis of the extracted region information, the imagedata of the region from the payload part included in the transmittingsignal received by the reception section.

(10)

The reception apparatus as stated in paragraph (9) above, in which theregion information includes information indicative of the size of theregion and information indicative of the number of frames of the imagetransmitted in the region.

(11)

The reception apparatus as stated in paragraph (9) above, in which thereception section receives the signal according to the MIPI (MobileIndustry Processor Interface) CSI (Camera Serial Interface)-2 standard,the MIPI CSI-3 standard, or the MIPI DSI (Display Serial Interface)standard.

(12)

A transmission apparatus including:

an image processing section configured to read out image data at leasteither in a first mode for reading out a whole captured region or in asecond mode for reading out a partial region in the captured region; and

a transmission section configured to store the image data read out bythe image processing section into a transmitting signal complying with apredetermined format before transmitting the image data,

in which the image processing section varies a rate at which the imageis to be read out in the second mode.

(13)

The transmission apparatus as stated in paragraph (12) above, in whichthe image processing section determines a size of the region in keepingwith a frame rate at a time of readout in the second mode.

(14)

The transmission apparatus as stated in paragraph (12) above, in whichthe image processing section determines a frame rate in keeping with asize of the region at a time of readout in the second mode.

(15)

The transmission apparatus as stated in paragraph (12) above, in whichthe image processing section determines an exposure time in the secondmode, based on a size of the region in the second mode and on anexposure time in the first mode.

(16)

The transmission apparatus as stated in paragraph (12) above, in whichthe image processing section determines a size of the region in thesecond mode, based on an exposure time in the second mode and on anexposure time in the first mode.

(17)

The transmission apparatus as stated in any one of paragraphs (12) to(16) above, in which the transmitting signal includes a payload part ofa packet in which the image data is stored and a predetermined headerpart including information regarding the image data.

(18)

The transmission apparatus as stated in paragraph (17) above, in whichthe header part includes region information regarding the region.

(19)

The transmission apparatus as stated in paragraph (18) above, in whichthe region information includes information indicative of the size ofthe region and information indicative of the number of frames of theimage transmitted in the region.

(20)

The transmission apparatus as stated in any one of paragraphs (12) to(19) above, in which the transmission section transmits the signalaccording to the MIPI-2 standard, the MIPI CSI-3 standard, or the MIPIDSI standard.

REFERENCE SIGNS LIST

-   -   100: Image sensor    -   200: Processor    -   1000: Communication system

1. A reception apparatus comprising: a reception section configured toreceive data; and an information processing section configured togenerate an image, based on image data output from the receptionsection, wherein the reception section outputs, in a first mode, a wholecaptured region as the image data and outputs, in a second mode, apartial region in the captured region as the image data, the receiptsection selecting either the first mode or the second mode on a basis ofadditional information included in the image data.
 2. The receptionapparatus according to claim 1, wherein the information processingsection generates the image by combining plural images of the image datareceived in the second mode.
 3. The reception apparatus according toclaim 1, further comprising: a transmission section configured totransmit region information data to an imaging apparatus, wherein theinformation processing section generates the region information data, bydetermining the partial region to be acquired of the captured region,based on the image generated in the first mode.
 4. The receptionapparatus according to claim 2, wherein the information processingsection determines the number of images to be combined of the image datareceived in the second mode.
 5. The reception apparatus according toclaim 3, wherein the size of the region in the second mode is determinedby an exposure time in the second mode and by an exposure time in thefirst mode.
 6. The reception apparatus according to claim 3, wherein theinformation processing section generates information representingcoordinates and the size of the region in the second mode as the regioninformation data, the information processing section further supplyingthe generated information to the reception section.
 7. The receptionapparatus according to claim 1, wherein the information processingsection uses the region read out in the second mode and any otherregions than that region when generating the image in the first mode ina frame immediately following readout in the second mode.
 8. Thereception apparatus according to claim 1, wherein the reception sectionreceives a transmitting signal in which a payload part of a packetincludes the image data and in which a predetermined header partincludes the additional information.
 9. The reception apparatusaccording to claim 8, wherein the information processing sectionextracts region information regarding the region from the header partincluded in the transmitting signal received by the reception section,the information processing section further extracting, on a basis of theextracted region information, the image data of the region from thepayload part included in the transmitting signal received by thereception section.
 10. The reception apparatus according to claim 9,wherein the region information includes information indicative of thesize of the region and information indicative of the number of frames ofthe image transmitted in the region.
 11. The reception apparatusaccording to claim 8, wherein the reception section receives the signalaccording to the MIPI (Mobile Industry Processor Interface) CSI (CameraSerial Interface)-2 standard, the MIPI CSI-3 standard, or the MIPI DSI(Display Serial Interface) standard.
 12. A transmission apparatuscomprising: an image processing section configured to read out imagedata at least either in a first mode for reading out a whole capturedregion or in a second mode for reading out a partial region in thecaptured region; and a transmission section configured to store theimage data read out by the image processing section into a transmittingsignal complying with a predetermined format before transmitting theimage data, wherein the image processing section varies a rate at whichthe image is to be read out in the second mode.
 13. The transmissionapparatus according to claim 12, wherein the image processing sectiondetermines a size of the region in keeping with a frame rate at a timeof readout in the second mode.
 14. The transmission apparatus accordingto claim 12, wherein the image processing section determines a framerate in keeping with a size of the region at a time of readout in thesecond mode.
 15. The transmission apparatus according to claim 12,wherein the image processing section determines an exposure time in thesecond mode, based on a size of the region in the second mode and on anexposure time in the first mode.
 16. The transmission apparatusaccording to claim 12, wherein the image processing section determines asize of the region in the second mode, based on an exposure time in thesecond mode and on an exposure time in the first mode.
 17. Thetransmission apparatus according to claim 12, wherein the transmittingsignal includes a payload part of a packet in which the image data isstored and a predetermined header part including information regardingthe image data.
 18. The transmission apparatus according to claim 17,wherein the header part includes region information regarding theregion.
 19. The transmission apparatus according to claim 18, whereinthe region information includes information indicative of a size of theregion and information indicative of the number of frames of the imagetransmitted in the region.
 20. The transmission apparatus according toclaim 12, wherein the transmission section transmits the signalaccording to the MIPI-2 standard, the MIPI CSI-3 standard, or the MIPIDSI standard.